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(54) Removing color moire patterns from digital images having known chromatlclties 

(57) A method for removing color moire pattern 
noise having known chromatlcities from a digital image 
is disclosed. The chromaticltles are used to detemiine 
the region of color moire. The chromaticities within the 
region of color moire are then changed in accordance 
with the chromaticities of the located pixels in the region 
of color moire so that the color moire pattern noise is 
reduced. 
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Description 

[0001] The present invention relates to providing 
digital images with reduced color moire patterns. 
[0002] One type of noise found in digital camera 
images appears as low frequency, highly colored pat- 
terns in regions of high spatial frequency, for example, 
tweed patterns in clothing. These patterns, called color 
moire patterns or, simply, color moire, produce large, 
slowly varying colored wavy patterns in an othenwise 
spatially busy region. Color moire pattems are also 
referred to as chroma aliasing pattems, or, simply, 
chroma aliasing. 

[0003] There are numerous ways in the prior art for 
reducing color moire patterns in digital images. Among 
these are numerous patents that describe color moire 
pattern reduction methods using optical blur filters in 
digital cameras to avoid aliasing induced color moire in 
the first place. However, these blur filters also blur gen- 
uine spatial detail in the image that may not be recover- 
able by subsequent image processing methods. 
[0004] Some approaches deal specifically with dig- 
ital image processing methods for reducing or removing 
chroma noise artifacts. One class of digital camera pat- 
ents discloses improvements to the color fitter array 
(CPA) interpolation operation to reduce or eliminate 
high frequency chroma noise artifacts. Another class of 
patents teach using different pixel shapes (that is, rec- 
tangles instead of squares) and arrangements (for 
example, each row is offset by half a pixel width from the 
preceding row) with accompanying CPA interpolation 
operations to reduce or eliminate chroma noise arti- 
facts. However, these techniques address only high fre- 
quency chroma noise, and are generally ineffective 
against low frequency color moire. 
[0005] There is the well known technique in the 
open literature of taking a digital image with chroma 
noise artifacts, converting the image to a luminance - 
chrominance space, such as CIELAB, blurring the 
chrominance channels and then converting the image 
back to the original color space. This operation is a 
standard technique used to combat chroma noise. One 
liability with this approach is that there is no discrimina- 
tion during the blurring step between chroma noise arti- 
facts and genuine chroma scene detail. Consequently, 
sharp colored edges in the image begin to bleed color 
as the blurring become more aggressive. Usually, the 
color bleed has become unacceptable before most of 
the low frequency color moire is removed from the 
image. Also, rf any subsequent image processing is per- 
formed on the image, there is the possibility of amplify- 
ing the visibility of the color bleeding. A second liability 
of this approach is that a small, fixed blur kernel is 
almost required to try to contain the problem of color 
bleeding. However, to address low frequency color 
moire, large blur kernels would be needed to achieve 
the desired noise cleaning. 

[0006] It is an object of the present invention to 



remove low frequency color moire from a digital image. 
[0007] It is another object of the present invention to 
remove low frequency color moire from a digital image 
by using known chromaticities from the color digital 
5 image. 

[0008] It is another object of this invention to pro- 
vide an improved color moire cleaned digital image 
using known chromaticities from the color digital image. 
[0009] These objects are achieved with a method of 
10 removing color moire pattern noise having known chro- 
maticities from a color digital image comprising: 

locating the pixels having the known chromaticities 
in the digital image to determine the region of color 
15 moire; and 

changing the chromaticities of the located pixels in 
accordance with the chromaticities of the located 
pixels in the region of color moire so that the color 
moire pattern noise is reduced. 

20 

[0010] The present invention overcomes the limita- 
tion of the "chroma blur trick" by first separating the 
regions of the image with color moire from the rest of the 
image. Color moire regions, alone, are then processed, 
25 leaving the rest of the image unaltered. Secondly, rather 
than performing a formal blur on chroma aliased data, 
resetting the chroma values to an appropriate value 
eliminate any migration of errors into adjacent pixels. 
[001 1 ] The features of this invention include: 

30 

1) automated operation (no user intervention is 
required, although the user could be given access 
to some algorithm parameters to control the 
aggressiveness of image modification), and 
35 2) minimal computational load (convolution meth- 
ods, the standard approach to this problem, are 
avoided). 

[001 2] A novel aspect of this invention is that It uses 
40 knowledge of the color filter array (CPA) spatial sam- 
pling characteristics to separate chroma aliasing from 
genuine scene information so that the former can be 
eliminated from the image. 

45 PIG. 1 is an illustration of color moire pattems 
caused by a Bayer an^y in which unique chromatic- 
ities are created; 

PIG. 2 is a block diagram of the processing flow for 
practicing the present invention to produce 
so improved digital images; and 

PIG. 3 is an illustration similar to PIG. 1 of color 
moire patterns caused by another color filter array 
in which unique chromaticities are created. 

55 [0013] Since noise cleaning algorithms for digital 
images are well known, the present description will be 
directed in particular to elements forming part of, or 
cooperating more directly with, apparatus and method 
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in accordance with the present invention. Elements not 
specifically shown or described herein may be selected 
from those known In the art. Although the present inven- 
tion will be described in relation to a digital image pro- 
duced by an electronic camera, it will be understood by 
those skilled in the art that the present invention is not 
limited to such image product devices and can use orig- 
inal digital images from other sources. 
[0014] Referring to FIG. 1, a digital camera image 
captured with a Bayer CFA pattern will produce color 
moire patterns with four specific colors. The Bayer an^y 
Is disclosed in commonly assigned US-A-3.971 ,065 and 
uses red, green and blue pixels with a repeating pixel 
kernel 

G R 
BG 

wherein G is green, R is red, and B Is blue. In the figure, 
R is red, G is green. B is blue, C is cyan, M is magenta, 
and Y is yellow. Although the Bayer anay is prefen-ed, 
other patterns with repeating color kernel pixels can 
also be used in accordance with the present invention. 
Moreover, different filters other than red. green, and 
blue such as cyan, magenta and yellow. Aliasing at 45 
degrees will create either a green pattern or a magenta 
pattern (red plus blue). Aliasing along the axes will cre- 
ate either cyan (green plus blue) or yellow (red plus 
green) patterns. These aliasing colors tend to be satu- 
rated and, as a result, relatively easy to separate from 
genuine scene colors. 

[0015] Refen-ing to FIG. 2, block 10 represents the 
initial image, which has unwanted chroma aliasing, or 
moire patterns. In block 12, the image is converted to a 
luminance - chrominance space, such as CIELAB. 
Although the CIELAB color space is preferred, other 
color spaces that can be used in accordance with the 
present invention will suggest themselves to those 
skilled in the art. Other luminance - chrominance 
spaces, such as CIELUV and YCrCb, could be used, as 
well. At this point, inspection of the converted image 
shows that the chroma aliasing exists primarily in the 
chrominance (a* and b*) planes and not in the lumi- 
nance (L*) plane. In addition, the chroma aliasing pat- 
terns includes four colors: green, magenta, cyan, and 
yellow. In block 14, an existence map is created identify- 
ing the pixel locations of green chroma aliasing pat- 
terns. This is done by simply comparing the L*. a*, and 
b* values of each pixel and seeing if they are within 
range of the aliasing green color created by the Bayer 
pattern. Blocks 16 and 18 create the same types of 
existence maps for magenta and cyan aliasing colors, 
accordingly. In block 20, the existence maps created in 
blocks 1 4, 1 6, and 1 8 are merged into a single existence 
map. This merging is accomplished by performing a 
mathematical OR operation of the three individual exist- 
ence maps. Next, the yellow chroma aliasing patterns 
are identified, A problem with the yellow patterns is that 



the yellow can be very close to skin tone colors, making 
a simple, color based separation difficult. However, 
wavy gaps in the existence map indicate the location of 
these yellow chroma aliasing patterns. So, in block 22, a 

5 simple dilate operation on the existence map to fill in 
these wavy gaps properly identifies the yellow chroma 
aliasing patterns without selecting larger and more reg- 
ularly shaped skin tone regions. At the conclusion of 
block 22. the existence map locates (identifies) pixels in 

10 the region of color moire in the image. In block 24, the a* 
and b* values of each pixel tagged by the existence map 
are averaged to get a global mean value for^ a* and b* for 
the chroma aliased pixels. Block 24 can be viewed as a 
very large blur kernel operation. In block 26, the a* and 

15 b* values of each of the tagged pixels are set equal to 
the global mean a* and b* values calculated in block 24. 
This operation eliminates the chroma aliasing patterns. 
In block 28. the processed image is converted back to 
the original color space. 

20 [0016] Although the present invention has been 
described using a standard Bayer array, another color 
filter anay having the following repeating kernel: 

YM 

25 C Y 

wherein Y is yellow, M is magenta, and C Is cyan is par- 
ticulariy suitable for use with the present invention. 
When using this kernel the pixels having the known 

30 chromaticities of yellow, light blue, light green, and light 
red caused by the repeating kemel in the digital image 
to determine the region of color moire (See FIG. 3).. By 
changing the chromaticities of the located pixels in 
accordance with the chromaticities of the located pixels 

35 in the region of color moire so that the color moire pat- 
tern noise is reduced. 

[0017] The present invention can be embodied in a 
software program provided in a computer program prod- 
uct, having a computer readable storage medium hav- 
40 ing a computer program stored thereon removing color 
moire pattern noise having known chromaticities from a 
color digital image. The computer program performs the 
steps of: 

45 a) locating the pixels having the known chromatici- 
ties in the digital image to determine the region of 
color moire; and 

b) changing the chromaticities of the located pixels 
in accordance with the chromaticities of the located 
50 pixels in the region of color moire so that the color 
moire pattern noise is reduced. 

[0018] The computer readable storage medium 
may comprise, for example, magnetic storage media, 
55 such as magnetic disks (such as a floppy disk) or mag- 
netic tape; optical storage media such as an optical 
disk, optical tape or machine readable memory (RAM), 
or read only memory (ROM); or any other physical 
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device or medium. 
Claims 

1. A method of removing color moire pattern noise s 
having i<nown chromaticities from a color digital 
image comprising: 

a) locating the pixels having the l<nown chro- 
maticities in the digital image to determine the io 
region of color moire; and 

b) changing the chromaticities of the located 
pixels in accordance with the chromaticities of 
the located pixels in the region of color moire 
so that the color moire pattern noise is 
reduced. 

2. A method of claim 1 wherein the chromaticities of 
the located pixels are changed by averaging the 
chromaticities of the located pixels. 

3. A method of removing color moire pattern noise 
having known chromaticities from a color digital 
image taken by an image sensor having the follow- 
ing repeating kernel: 25 

GR 
BG 



15 



20 



moire; and 

b) changing the chromatfcrties of the located 
pixels in accordance with the chromaticities of 
the located pixels in the region of color moire 
so that the color moire pattern noise is 
reduced. 

A computer program product, comprising a compu- 
ter readable storage medium having a computer 
program stored thereon for removing color moire 
pattem noise having known chromaticities from a 
color digital image for performing the steps of: 

a) locating the pixels having the known chro- 
maticities in the digital image to determine the 
region of color moire; and 

b) changing the chromaticities of the located 
pixels in accordance with the chromaticities of 
the located pixels in the region of color moire 
so that the color moire pattern noise is 
reduced. 



wherein G is green, R is red, and B is blue, compris- 30 
ing: 



a) locating the pixels having the known chro- 
maticities of green, magenta, cyan, and yellow 
caused by the repeating kernel in the digital 
image to determine the region of color moire; 
and 

b) changing the chromaticities of the located 
pixels in accordance with the chromaticities of 
the located pixels in the region of color moire 
so that the color moire pattem noise is 
reduced. 



35 



40 



A method of removing color moire pattern noise 
having known chromaticities from a color digital 
image taken by an image sensor having the follow- 
ing repeating kernel: 

YM 

CY 

wherein Y is yellow, M is magenta, and C is cyan, 
comprising: 

a) locating the pixels having the known chro- 
maticities of yellow, light blue, light green, and 
light red caused by the repeating kernel in the 
digital image to determine the region of color 
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